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?SSFACE 


This  report  io  the  terxth  in  a aeries  published  by  the  Electronics 
^ Personnel  Research  group.  The  firat  seven  described  shipboard  observa- 

tion of  electronics  personnel  aboard  ships  of  the  destroyer  class.  T.he 
eighth,  ninth,  and  tenth  reports  EJ-e  concerned  witn  the  results  of  col- 
lateral research. 

The  ninth  report  describes  a new  type  of  test  format,  the  MASTS 
test,  designed  for  measuring  some  aspects  of  trouble  shooting  skill, 
and  sets  forth  the  conception  of  trouble  shcotlng  underlying  its  devel- 
opment . 

This  report  contains  a summarj’  of  the  results  of  a preliminary  study 
In  which  the  .MASTS  test,  a job-sample  test,  three  conventional  electron- 
ics testa,  and  several  ability  reference  tests  were  aiminlstered  to  a 
small  sample  of  Electronics  Technicians  from  s/iipp  under, -roing  repairs  in 
the  Long  Bench  Naval  Shipyard. 

The  study  yielded  positive  results  insofar  as  the  experimental  in- 
strument was  concarned.  However,  it  had  two  characteristics  v'hich  pre- 
clvidad  its  economical  use  on  large  samples:  it  was  an  individual  test 
and  it  required  an  observer  to  record  eacn  subject's  preeolution  res- 
ponceo.  In  view  of  the  fact  that  t’.io  preliminary  result?  were  promising, 
^ an  imniedir.to  rsviciori  of  the  MA.STa  tests  war.  begrinj  pad  currently  is  in 

progress,  to  convert  the  instrument  from  an  individual  to  a group  test, 
and  to  provide  a .mechanism  for  automaticelly  recording  the  subject's 
succe.ssive  reopoases-  Because  of  this  self-recording  feature,  the  name 

1 S'  j.  c i.  I bO  viiC  X' C V .*  iw .*  vii  ♦ 


In  the  interests  of  economy,  it  has  been  necessary  for  the  project 
to  concentrate  ite  effortc  on  the  AUTOM.“ST5.  Therofore,  Technical  Report 
No.  10  must  be  considered  as  an  interim  report  covering  a portion  of  the 
performance  records  which  were  collected  at  long  Beach.  Specifically, 
the  report  contains  only  eiid-product  scores,  so  far  as  the  MASTS  test 
and  the  job-sample  test  are  concerned.  The  detailed  records  v.'hich  were 
taken  of  the  subjects'  presolution  responses  ore  being  used  in  conjunc- 
tion vnth  tlie  development  of  new  scoring  parameters  for  the  revised  teat, 
and  will  be  discussed  in  the  reports  concerned  with  that  instrument. 


-i- 


ACKNOWLEDGKENTS 


The  research  reported  in  this  series  reflects  tne  contrihution  of 
a large  nucher  of  persona  within  the  Military  Eatahlishment.  Grateful 
appreciation  for  this  assistance  is  extended  to  the  Cimiser  Destroyer 
Torce,  Pacific;  the  Training  Division  and  the  Personnel  Analysis  Divi- 
sion, Bureau  of  Naval  Personnel;  the  personnel  and  Training  Branch  of 
the  Psychological  Services  Division  of  the  Office  cf  Naval  Research; 
and  the  Electronics  Coordinator' s ■ Section  of  the  Office  of  the  Chief  of 
Naval  Operations. 

ihe  cooperation  of  the  Commanding  Officer,  and  of  Mr.  J.  Wesley 
Johnson,  Superintendent  of  Training,  Long  Beach  Naval  Shipyard,  in  per- 
mitting field  work  to  be  dona  there,  and  in  providijig  testing  space,  is 
especially  appreciated. 

Mr.  William  Hickman,  Training  Division,  Long  Beach  Naval  Shipyard, 
devoted  many  hours  of  his  own  time  to  orienting  two  of  the  project  per- 
sonnel in  electronics  and  in  acting  as  a technical  consultant.  His  con- 
tribution is  gratefully  acknowledged.. 

■ The  ncn-electronlc  reference  tests  were  obtained  thro;uch  the  cori.”-' 
tesy  of  Dr.  J.  P.  Guilford  and  Mr.  P.  R.  Christensen  of  the  High-Level 
Aptitudes  Research  Project,  Contract  NSotir-EJG-lG,  University  of  Gourn- 
ern  California. 

Mr.  John  R.  Hills,  half-time  research  assistant,  contributed  ma- 
terially to  the  collection  of  problem  information  and  to  the  planning 
o-r  +-.':t  f'D.-;.at.  Karold  H.  LcCor.,c  c.i.d  Jonaid  '.v.  Svenaon  served 

at  different  times  as  liaison  men  between  ship  personnel,  the  testing 
room,  and  the  Electronics  Personnel  Research  Offices. 


ABSTRACT 


This  report  summarizes  the  results  of  an  exploratory  use  of  the 
MASTS  test  v/ith  Electronics  Technicians.  This  test,  a Job-sample  test, 
and  several  electronics  and  ability  reference  tests  were  administered 
to  a small  sample  of  ETa , Rank  order  correlations  cf  end-product  scores, 
between  the  MASTS  test  and  its  Job-sample  counterpart,  were  positive  and 
slgnif icent . The  report  describes  the  tests  inv'olved  In  the  study,  the 
subjeci:  sample,  and  the  procedures  follower'.. 
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A methodological  STUDY  OF  ELECTHONICS  TROUBLE  SHOOTING  SKILL: 


U.  INTERCOMF ARISONS  OF  THE  MASTS  TEST,  A JOB- SAMPLE  TEST. 

TEN  REFERENCE  TESTS  ADi^iINISTERED  TO  ^ECT  ELIX;TR0NICS  TECmilClAl'iS 

I.  INTRODUCTION 

The  study  to  be  descrijed  is  part  of  a general  program  to 
analyze  objectively  and  to  describe  the  Job  of  the  naval  electronics 
technician.  Some  studies  in  the  program  liave  been  concerned  with  the 
observation  of  maintenance  problems  in  the  fleet  (Reports  1 through  7 
of  this  series),  v/hile  others  have  concentrated  on  the  analysis  of  the 
behavioral  aspects  of  electronics  trouble  shooting.  Following  a logical 
analysis  of  the  trouble  shooting  process,  a job-sample  test  requiring 
the  repair  of  standardized  equipment  was  developed,  along  with  a sym- 
bolic version  of  the  tasks  involved.  The  latter  v/as  put  into  a speciail 
test  format  called  tne  mAoIo  test,  (see  Report  y ox  tiiis  series).  The 
study  reported  here  gives  the  results  of  an  exploratory  administration 
of  several  measures  of  trouble  shooting  skill  to  a group  of  experienced 
electronics  technicians  In  the  fleet. 

The  study  had  three  specific  objectives: 

1.  The  first  v/as  to  evaluate  the  feasibility  nf  a trouble 
shooting  performance  test  more  symbolic  in  nature  than 
an  equipment  test  (or  performance  on  the  job),  yet  not 
as  restrictive  as  conventional  paper-and-pencil  tests. 

Such  an  instrument  (the  hiASTS  test)  was  evaluated  by 
compfiring  it  with  an  equipment  tost  in  terms  of  oud- 
product  scores. 


2.  Tho  second  goal  involved^collecting  empirical  informa- 
tion from  which  revision  and  improved  development  of 
such  a test  could  he  achieved.  If  the  instrument  proved 
feasible. 

3*  The  tliird  objective  was  to  explore  the  relationships 
amon^  the  two  performance  tests  (Job-sample  and  i'-lt-STc) 
and  selected  reference  variables.  The  reference  mea- 
sures v;ere  of  thrae  main  classes:  paper-and-pencil 

electronics  tests,  ability  reference  tests,  and  super- 
visor's ratings. 


II.  DESCRIPTION  CF  hATERlALS  AiiD  SUBJECTS 

Fourteen  measurements,  exclusive  of  part  scores,  were  made  for  each 
of  36  electronics  technicians.  The  measurements  consisted  of  one  Job- 
sample  trouble  shooting  tost,  two  forms  of  tho  MASTS  test  (Plate  1), 
three  electronics  reference  tests,  seven  ability  reference  tests,  and  one 
supervisor's  rating.  Each  of  the  tests  and  the  subject  sample  is  des- 
cribed below. 


A.  The  Job  Sample  Test  ( JS) 

A performance  test  which  closely  resembled  the  trouble  shooting  of 
fleet  electronics  equipment  was  constructed  from  the  circuit  training 
racks  and  chassis  developed  by  Philco.  This  gear  had  interchangeable 
chassis  ccrrespondii^g  to  circuit  stages.  V.’ith  the  exception  of  lai’ge 
transformers  and  some  potentiometers,  components  were  mounted  on  re- 
movable strips.  This  made  replacement  of  components  easy  and  facilitated 
introducing  test  problems  (malfunctions)  into  the  instrument  (see  Plate  2.) 

Twe  separate  racks  were  employed  for  the  test.  The  chassis  for  a 
ccnventicnal  superheterodyne  receiver  v;ere  assembled  on  one  rack.  The 
other  rack  contained  e.  ainiplifiei  sveep  gorernT-or  comparable  to  that 


used  in  radar  circuits-  As  ^ result  of  preliminary  testir^g,  V./o  sets 
of  protleiiia  in  the  form  of  malfunctions  (faults)  introduced  into  the 
equipment  were  selected.  These  ware  used  for  alternate  testa,  each 
having  six  receiver  and  six  radar  problems.  The  problems  were  care- 
fully selected  and  matched  according  to  characteristic  component  fail- 
ures of  particular  circuits  cr  stoges. 

Auxiliai'y  equipment  for  the  job-sample  test  included  a multimeter, 
signal  generator,  tube  tester,  cathode  ray  oscillograph,  a set  of  hand 
tools,  a rack  containing  spare  parts,  and  a list  of  component  values 
and  circuit  voltages.  Each  subject  v.ae  introduced  to  the  gear  by  a des- 
cription of  its  general  physical  la^vout . lie  was  given  an  opportunity 
to  observe  the  equipment  in  normal  operating  condition  and  to  study  the 
schematic  diagrams.  This  was  followed  by  a warm-up  problem  to  further 
orient  the  subject  and  to  answer  his  introductory  questions.  For  each 
snbseq'ient  problem  "ar  giver.  gc;...-al  outp...  suon 

as  might  be  reported  by  an  operator  calling  for  an  ET. 

By  means  of  a special  code  a detailed  account  of  the  step  by  step 
r&spoiises  of  each  technician  was  made  ns  he  used  test  equipment  at  test 
points  and  applied  other  llagncstic  procedures  to  the  equipment-  Initial 
scoring  was  do.ne  in  terms  of  the  total  number  of  proble.7is  solved  and  the 
median  solution  time  per  problem.  Each  proolem  was  considered  solved 
when  the  gear  v/as  put  back  iu  uorii^l  operation.  A tiaje  limit  of  35 
minutes  per  problem  v/as  used  in  the  job-sample  test. 

B.  The  Multiple  Alternative  t^vmtiolic  Trouble  Shooting  Test  (fUiSTS) 

This  test  replaced  both  electronic  equipment  and  test  instniments 
in  the  trouble  shooting  situation,  by  s 3ym"tx)lic  format  v/hich  contained 


a majority  of  tho  subtauka  represented  in  trouble  shooting  behavior. 

For  each  problem,  the  subject  was  provided  with  a pool  of  information, 
v'hich  he  could  sample  according  to  his  own  inclinations. 

The  apparatus  and  procedure  for  the  i-iASTS  test  wore  described  and 
illustrated  in  detail  in  Report  9 of  this  series.  In  brief,  it  consis- 
ted of  a masonite  board  containing  a matrix  of  holes,  each  provided 
with  a removable  cork.  (Plate  1) . Wien  a cork  was  removed,  a unit  of 
the  information  typed  on  a problem  sheet  oeneath  the  board  was  made 
visible.  One  hundred  groups  of  five  holes  each  wero  used  to  represent 
information  on  100  different  test  points  within  the  circuit  in  q^uestion. 
Five  classes  of  information,  AC  volts,  DC  volts,  ohms,  signal  generator 
readings,  or  wave  forms,  and  the  effect  of  "tapping"  a test  point  with 
a screwdriver  were  included  in  the  problem  sheets. 

In  addition  to  the  section  containing  information  at  test  points, 
tnere  v/as  a panel  containing  holes  for  each  component  in  the  circuit, 
includir.g  major  loads.  The  first  celvi'nn  provided  information  which 
would  be  obtained  from  varying  front  panel  controls  and  screwdriver  ad- 
justments. Six  other  columns  were  labeled  "suostitute  new  component." 
For  any  peirticular  problem,  one  of  the  corks  in  this  section  corres- 
ponded to  the  component  in  the  circuit  which  caused  the  malfunction. 
Under  it  was  printed  the  phrase  "goer  normal."  The  spaces  under  the 
other  corks  in  this  section  were  blank. 

The  iiASTS  test  contained  twelve  receiver  problems  and  twelve  radar 
problems.  These  viers  divided  Into  two  groups  lu  urovi.ie  tw^o  sets  of 
problems,  either  of  wnich  could  be  used  as  one  test.  These  tests  ware 
administered  individually  according  to  a standard  procedure  wr.ich  vas 


descrllied  in  detail  in  Report.  9.  A tine  limit  of  20  minutes  per  protslem 
vas  used.  The  follov'ing  performance  records  were  obtained  from  each 
subject:  (a)  time  required  to  solve  each  problem,  (b)  number  of  problems 
solved,  and  (c)  complete  response  records  of  pre-solution  behavior. 


£.  The  Modified  MASTS  Test 

A variation  of  the  mASTS  test  v/as  introduced  to  study  the  effect 
of  making  the  discrimination  of  "usual"  or  "unusual"  for  each  unit  of 
test  point  information  available  to  the  subject.  It  v.»a3  identical  with 
the  wASTS  test  except  that  all  the  readinji'S  were  expressed  in  v/ords 
which  related  the  particular  reading  fro.m  faulty  gear  to  the  corres- 
ponding reading  taken  v;hen  the  gear  was  functioning  normally. 

For  example,  when  a man  lifted  a particular  cork  to  obtain  a DC 
voltage  reading,  instead  of  seeing  a number  he  saw  one  of  the  following 
words  or  phrases:  "up  to  Infinity,"  "extremely  high,"  "somewhat  high," 
"usual,"  "somewhat  low,"  "extremely  low,"  or  "absent."  The  v;ord  "usual" 
meant  that  the  reading  at  this  pai'tlcular  point  •.•an  the  same  as  it  would 
be  if  there  were  no  fa'ult  in  the  gear. 


D.  Reference  Tests;  Pape r- and-Penc 1 1 Trouble  Shooting  Measures 

Three  paper-and-pencil  tests  oi  trouble  shooting  v>ere  constructed 
and  administered  as  part  of  the  test  battery.  The  three  tests  differed 
sy stematically  in  degree  of  abstraction  from  ohe  actual  trouble  shootir.g 
task.  The  first  (ER-1)  was  a multiple-choice  test  of  theory  and  elec- 
tronics kno', -ledge,  particularly  of  hew  radio  receiver  o.nd  radar  circuits 
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;ond  iIZ.-2)  wc  s a multlple-cnoice  test  of  general 


trouble  snooting  in  wr.icn  generalized  faults  or  malfunctions  v/ere  related 
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to  possible  causes. 

The  items  of  the  third  paper-and -pencil  test  (ER-3)  \vere  based  on 
the  same  circuits  used  in,  and  on  problems  similar  to  the  trouble  shoot- 
ing problems  in  the  job-sample  and  MASTS  formats.  It  presented  these 
problems  in  terms  of  the  conventional  multiple-choice  and  other  short 
answer  type  of  item,  A verbal  8ta.tement  of  symptoms  x-ras  made,  follov/ed 
by  alternate  statements  about  test  points,  relevant  circuit  teste,  or 
likely  faulty  components. 

E.  Reference  Tests:  Abl lity  Measures 

A saries  of  additional  ability  measures  were  introduced  in  an  at- 
tempt tc  add  meaning  to  any  relationships  detsi-mined  among  the  perform- 
ance variables.  These  ability  tests  were  chosen  from  published  tests 
on  which  standardization  information  was  available.  Particular  atten- 
tion was  paid  to  the  likely  relevance  of  their  factorial  content  to  per- 
formance variables  in  the  trouble  shooting  realm. 

Two  01  tne  tests  v;ere  fi  om  the  Guiiroxu.-Ziiii.xici  mtui  Aptitude  Survey, 
Part  I,  Verbal  Comprehension,  and  Part  VI,  Spatial  Visualization.  All 
others  were  special  tests  developed  in  connection  with  Naval  studies  of 
reasoning  and  flexibility  of  set.  They  included;  the  ”.S.  Navy  Reasoning 
Test  I;  Problem  Solving,  Form  AX2;  Logical  Reasoning,  RL.ROpA:  Circle 
Reasoning  (no  code) ; Hatch  Problems  CXOJB;  and  Brick  Uses  CFOUa. 

These  particular  tests  were  chosen  because  the  abilities  which  they 
measure  were  hypothesized  to  be  related  to  the  skills  required  in  trouble 
shooting  electronics  gear.  The  first  two  concerned  comprehension  of 
verbal  materials  and  the  ability  to  vi  .dualize  spatial  relationships, 
which  were  believed  to  play  a part  in  electronics  repair.  A second  group 


of  testa  sampled  reasonia^  and  problem  solving  abilltias.  The  last  two 
sets  explored  the  element  of  flexibility  of  behavior,  some  aspects  of 
which  (e.g.,  functional  fixedness)  have  been  shown  to  be  relevant  to 
lack  of  success  in  problom  solving  behavior. 


F.  Sub.jects 

The  measures  described  above  were  administered  to  thirty-six  ex- 
perienced ETs  obtained  from  ten  ships  in  the  Pacific  Fleet  (8  des- 
troyers, 1 cruiser,  1 carrier).  The  services  of  these  men  were  made 
available  while  the  ships  v;ere  in  the  Long  Beach  Naval  Shipyard  for  re- 
pair, Facilities  for  testing  weie  provided  through  cooperation  ox"  the 
Training  Division  of  the  shipyard. 

In  selecting  subjects  for  testing,  two  criteria  other  than  avail- 
ability ware  used.  No  strikers  were  included  who  had  not  attended 
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the  possibility  that  they  ma.v  have  become  primarily  supervisors.  A de- 
tailed account  of  the  ET  sample  by  classes  of  ship,  rate,  length  of  ex- 
perience as  ETs,  and  extent  of  formal  electronii-s  schooling  is  given  in 
Tables  A and  B in  the  appendix  to  this  report. 


III.  THE  experimental  DE3IGN 

Because  ox"  the  fact  that  the  prlxicipal  measures  in  the  group,  the 
job-sample  and  i-b.3Td  teats,  had  not  been  used  extensively  before,  it  was 
not  possible  to  predict  the  effect  of  certoin  te-^t  i-idmxni  stration  va- 
riables such  as  the  ox-der  of  adi  I ni s tration  ox  xne  tests,  tJic  crier  of 

4.U-.  3 A i jd  - u.-*..--.. 
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It  wae  therefore  neceesary  to  choose  between  two  somewhat  oppose!  goals 
for  the  obeervational  situation:  (1)  to  maintEin  the  above  condition?  at 
as  constant  a value  as  possible  in  an  attempt  to  keep  correlations  among 
the  variables  as  high  as  possiblej  or  (2)  to  systematically  vary  the 
conditions  v;hlch  appeared  relevant  in  order  that  the  extent  to  v/hich 
they  would  affect  test  results  could  be  objectively  assessed. 

In  evaluating  these  alternatives  it  was  recognised  that  the  former 
would  maximize  the  intercorrelati ons  among  variables  unless  some  unfor- 
tunate selection  of  the  "constant"  values  was  chosen.  On  the  other  hand, 
this  approach  would  yield  no  objective  data  on  the  effects  of  these  va- 
riables which  could  he  utilized  in  further  work  with  the  Instruments. 

The  second  alternative  possesses  almost  opposite  advantages  and 
disadvantages.  I’y  systomn  tic.  ally  varying  the  test  odmi  ni  strati  on  vari- 
ables, one  could  objectively  evaluate  their  influence,  but  correlations 
would  be  attc  .ated  if  those  variables  influenced  scores. 

Because  the  study  was  considered  to  be  primarily  an  exploratory  one, 
the  decision  vas  made  to  adopt  a compromise  solution.  A counterba lanced 
design  was  developed  which  systematically  varied  (1)  the  order  of  admin- 
istration of  the  Job-sample  end  .*>iASTS  tests,  (2)  the  order  of  the  prob- 
lems within  the  test,  and  (;>)  tne  assignment  of  problem  groups  (equiva- 
lence of  probie.'os)  . The  design  is  diagrammed  in  Table  C of  the  appendix. 
Twenty-four  subjects  were  required  for  one  edministraticrA  without  rspli- 
cation.  Because  the  complete  administration  in  counterbalanced  order 
rsciuires  a very  long  testing  time  per  subject,  only  one  replication  of 
tne  design  (24  subjects)  was  used.  To  tnis  was  added  a group  cx  12  sub- 
jects for  v;hom  all  conditions  were  kept  as  uniform  as  possible. 


These  12  subjects  duplicated  the  conditions  of  6 of  the  "couiiterbalanced" 
subjects,  resulting  in  a "homogeneous"  group  of  18  subjects. 

In  summary,  then,  the  compromise  program  of  the  research  was  to  ad- 
minister to  24  subjects  one  replication  of  the  counterbalanced  design 
described  in  Table  C of  the  appendix,  and  to  use  a homogeneous  set  of 
conditions  for  an  additional  sample  of  12  subjects.  The  set  of  values 
of  the  "conti'olled"  variables  used  for  the  "homogeneous"  group  corres- 
ponds to  the  top  row  of  the  counterbalanced  design  (job-sample  test  first; 
problem  order  A,  B,  C,  D,  E,  F etc.).  Subsequent  analyses  will  be  made 
in  terms  of  the  total  group  (36  men),  the  homogeneous  sub-group  (IS  men), 
and  the  counterbalanced  (heterogeneous)  sub-groups  (24  men). 


IV.  RESULTS 

A.  Comparison  of  the  mASTS  Tests  rfl th  the  Job  Sample  Test 

i.  The  Test . On  the  assumption  that  the  symbolic  (MASTS) 

test  measures  many  of  the  same  skills  that  the  job-sample  test  does,  a 
significant  correlation  would  be  expected  between  scores  on  the  two  meas- 
ures. Two  classes  of  scores  could  be  used  for  studyiiig  th.is  relation- 
ship; one  based  on  gross  performance  ( suc'c  as  number  of  problems  solved 
and  time  required  for  solution),  ti-e  other  based  on  analysis  of  inter- 
mediate response  records.  Only  ths  first  of  these  will  be  discussed  in 
this  report. 

Several  types  of  gross  scores  are  available.  The  two  most 
obvious  are:  (a)  ths  number  of  proulems  solved  v/itiiin  the  problem  time 
limit,  and  (b)  some  average  (median)  of  tiie  solution  times  01  the  sub- 
ject per  test. 
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The  scores  vere  first  arranged  in  order  according  to  the  number  cf 
problems  solved.  Then,  since  there  were  several  persons  with  the  seme 
number  of  solutions,  the  median  solution  times  were  introduced  as  a basis 
for  differentiatirig  among  these  "ties."  For  these  combination  measures, 
the  rank  order  correlations  between  job-sample  and  mA5T 3 tot;  1 scores 
for  different  subject  and  problem  groups  are  given  in  Table  I.  Similar 
correlations  for  pert  scores  are  indicated  in  Table  II  for  the  total 
group  (F  = 36)’,  for  the  homogeneous  group  (N  = 18)!  and  for  the  counter- 
balanced group  (II  = . 


Table  i 

Rank  Order  Correlations  Between  Job  Sample  and  MASTS  Total  Scores 


All  subjects  

Ilho 

.56 

n 

.'6 

Siibiects  under  homogeneous  conditions.  . . . 

.61 

18 

Subjects  under  counterbalanea  conditions  . . 

24 

Counnerbalanced  subjects  receiving  alternate 
forms: 

J3  form  IIB  and  maSTS  form  lA  . . 

.45 

12 

Ji  form  lA  and  .-iaSTS  form  113  . . 

.63 

12 

In  summary,  these  correlations  indicated  a fairly  high  correlation 
between  job-sample  and  MASTS  total  scores  for  all  groups,  The  most 
stable  of  those  (K  = 3^)  would  lead  one  to  reject  the  hypothesis  of  no 
relationship  at  a signif leaner  level  of  one  percent.  The  correlations 
comciited  from  groups  having  the  same  problems  (>I  = IR)  were  more  vari- 
able with  values  octh  higher  ( .h'i)  and  lower  (.*^'3).  It  wrs  impossible 
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to  tell  from  these  data  whether  this  variation  was  due  to  problem  group 


differences  or  sajnpling  fluctuations. 

Table  II 

Rank  Order  Correlations  Between  Job  Sample  and  MASTS  Part  Scores 
from  Receiver  and  Radar  Sub-tests 


Total  Group  (N  = 3^) 

J3  Total  Score 
JS  Receiver  Part  Score 
JS  Radar  Part  Score 

Homogeneous  Sub-group 

■ (f”  18l 

JS  Toto.1  Score 

o’S  Receiver  Fart  Score 

JS  Radar  Part  Score 

Counterbalanced  Sub-group 

(M  = 

JS  Total  Score 
JS  Receiver  Part  Score 
JS  Radar  Part  Score 


MASTS 

MASTS 

MASTS 

Total 

Receiver 

Radar 

.56 

.43 

.39 

.56 

.21 

.38 

.43 

.30 

.13 

.61 

.63 

.34 

.74 

.36 

.Gs 

.45 

• 33 

.13 

.59 

.37 

,b2 

.57 

.21 

.52 

• 3b 

.38 

.13 

Correlations  among  part  scores  also  varied,  and  it  is  not  possible 
to  tell  which  differences  represent  true  differences.  However,  most  of 
the  correlations  are  moderately  high  and  positive.  Job-sample  receiver 
items  appeared  to  correlate  consistently  more  highly  v/ith  M.'iSTS  total 
scores  than  did  job-sample  radar  problems,  and  MASTS  radar  problems  ap- 
peared to  correlate  more  highly  with  job-sample  receiver  items  than  they 
did  with  job-sample  radar  items.  In  fact,  the  lcv;est  correlations 
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obtained  were  between  the  MASTS  radar  items  and  the  Job-sample  radar 
items.  This  was  duo  in  part  to  a very  swall  range  of  scores  in  the  radar 
sub- teats . 

Another  basis  for  comparing  the  two  test  formats  was  tlie  difference 
in  the  mean  number  of  correct  solutions  and  median  solution  times.  It 
will  be  noted  from  Table  III  that  the  job-sample  test  yielded  a signifi- 
cantly greater  average  number  of  solutions  than  did  the  MaSTS  test,  and 
for  the  homogeneous  group  of  subjects  (n  = 18)  the  job-sample  test  gave 
a signi f i CEjitly  longer  median  time  required  for  solution.  Of  these,  the 
former  comparison  (between  number  of  solutions)  was  more  meaningful  in 
this  context.  The  .MASTS  test  would  be  expected  to  take  less  time  because 
the  time  cpnsumption  per  move  was  less.  The  difference  in  apparent  sig- 
nificance of  solution  ti.ne  results  for  Ihe  two  groups  (counterbalanced, 
n = 2U,  and  homogeneous,  n = 18)  was  attributed  to  the  presence  of  admin- 
istrative variables  in  the  counterbalcinced  group  and  their  absence  ir 
the  ho.nogeneous  group. 


Table  III 

Differences  -Pef  /een  Job  Sample  and  MAv^TS  Tests  in  Terms  of 
Mean  Niamber  -of  Solutions  and  Means  of  Individu.al  Median  Solution  Times 


Job 


Sac;ple 

MASTS 

Diff . 

Drff . 

n 

t 

Number  correct  solutions 

Heterogeneous  group 

7.96 

6.75 

1.21 

• 393 

24 

3.U2*’' 

Homogeneous  group 

8.17 

6.94 

1.23 

.417 

18 

2.93"’ 

Solution  times  - minutes 

Heterogeneous  group 

15. ‘W 

I4.b4 

.76 

.870 

24 

.87 

Homogeneous  group 

15.22 

13.24 

1,98 

.802 

18  . 

2.47* 

«« 


Significant  at  .05  level 
Significant  at  .01  level 


The  t'icdlf led  MA3TS  Test . Th?  rcodified  form  of  the  eym- 
bolic  test  was  introduced  to  check  upon  the  effect  of  the  form  in  which 
the  information  was  provided  to  the  subject.  The  MASTS  test  was  modi- 
fied by  giving  verbal  information  at  test  points  rather  than  actual 
readings.  For  example,  words  like  "high”  or  "low”  took  the  place  of 
numbers  expressing  voltages,  ohms,  etc.'  (see  previous  section), 

CorrelatioriG  between  the  modified  MASTS  test  and  the  Job- 
sample  and  original  MASTS  tests  are  given  in  Table  IV,  In  interpreting 
these  results  it  is  important  to  keep  in  mind  that  the  modified  MASTS 
test  contained  only  six  receiver  items,  wliereas  the  original  M,-.STS  had 
six  receiver  and  six  radar  items.  This  reduced  the  range  of  scores, 
with  a consequent  effect'  upon  correlations.  The  correlations  between 
job-sample  total  scores  and  modified  MA.STS  total  scores  were  uniformly 
lower  than  those  between  job-sample  and  original  Hi, STS  scores.  However, 
the  amount  of  difference  was  small  and  could  be  due  entirely  to  the 
factors  mentioned  above  - and  not  to  Intrinsic  differences  between  ilie 
original  MASTS  and  the  modified  MASIS. 

The  conclusion  wnich  appeared  most  appropriate  here  was  that 
no  clear-cut  difference  between  the  tv.-o  M.-.STS  tests  was  reflected  by 
the  correlational  analysis. 

3-  Summary.  Homogeneous  &aoject  Group.  Table  IV  contains 
the  correlations  between  job-sample,  MASTS,  and  modified  MASTS  scores 
for  four  different  scoring  procedures.  The  group  on  which  these  values 
were  computed  was  the  ''homogeneous  subject  group',”  all  of  whom  took  the 
same  tests  and  the  same  pr'^blcm  groups  in  the  sa.me  order.  It  will  be 
noted  th.at  the  vcjiou«  scoring  procedures  yiei.lcd  comnarable  results  and 
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the  correlatione  were  similar  tc  those  in  Tables  1 and  II. 


Table  IV 


Rank  Order  Correlations  Between  Job  Sample,  MASTS,  end  Modified  MASTS 
Scores  for  Various  Scoring  Procedures* 

N = 12 


Test  and 

Scoring  Procedure 

MASTS 

Total 

MASTS 

Receiver 

MASTS 

Radar 

Modified 

MASTS 

Job  Sample  Total 

Number  solved 

.6o 

0‘3 

.44 

.49 

Mediein  time 

• 77 

.76 

.57 

.85 

Adjusted  cut-off 

.67 

• 7U 

.42 

.60 

Combined  score 

.61 

.63 

.3^ 

• J 1 

Job  Sample  Receiver 

Number  solved 

.71 

•55 

.66 

.68 

Median  time 

.58 

.52 

.65 

.64 

Adjusted  cut-off 

• 71 

.64 

.63 

.63 

Combined  score 

.74 

.56 

.68 

.75 

Job  Sample  Radar 

Number  solved 

.44 

• 5C 

.31 

Median  time 

.6b 

.25 

• 35 

A.djusted  cut-off 

• 37 

•54 

.10 

• 35 

Combined  score 

.45 

• 55 

•15 

• 32 

Modified  MASTS 

Numoer  solved 

.70 

■ 'J4 

•58 

Median  time 

.72 

.69 

•58 

Adjusted  cut-off 

.67 

.60 

.51 

Cou'uiiied  ticore 

• 73» 

06 

• b5 

* Number  solved;  number  of  problems  solved  within  respective  cut-off 
times. 

Median  time:  median  soluiior  times  per  subject  per  test  within  cut-offs. 

A.djusted  cut-off:  number  of  problems  solved  within  the  median 
solution  times  for  each  problem  group. 

Combined  score:  using  number  solved  to  rank  the  subjects  and  median 
time  to  resolve  tied  scores. 


B.  Comparison  of  Job  Sample  and  MASTS  Tests  With  Reference  Measures 
1.  Electronics  Reference  Tests . The  job-sample  and  ^LASTS 
tosts  were  constructed  on  the  assumption  that  more  of  the  true  variation 
in  trouble  shooting  behavior  could  be  captured  in  their  "renli stic" 
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formats  than  was  possible  with  more  conventional  achievement  tests  of 
tlie  paper-and-pencil  variety.  To  check  this  assumption,  three  paper- 
and-pencil  tests  (described  earlier)  wore  administered.  The  three  teste 
represented  different  subject  matters:  £H-1  covered  kr.ovrledge  of  elec- 
tronic theory;  ER-2  dealt  with  generalized  trouble  shooting  problems; 
and  ER-3  used  problems  from  the  philco  gear  as  the  basis  for  multiple- 
choice  typo  test  items. 

The  correlations  among  the  electronic  reference  tests  and  the 
job-sample  and  MASTS  tests  are  given  in  Table  V. 

Table  V 


Rank  Order  Correlations  between  Performance  (Job  Sample  and  MASTS)  Test 
Scores  amd  Scores  on  Three  Electronics  Reference  Tests  (.EP.-l,  ?.R-2,  PR- 

N = '56 


ER-1 

FR-2 

SR-5 

ConbiiifJ.  (Toual) 
ZR  Score 

Job  Sample  Test 

/* 

• Lc. 

• 

* 

Receiver  Part  Scorer, 

.6i 

. 76 

.54 

.6  c- 

Radar  Part  Scores 

• 52 

.45 

MASTS  Test 

Total  Scores 

• 5‘3 

.55 

.46 

•36 

Receiver  Fart  Scores 

• 50 

•35 

•34 

.4c 

Radar  Part  Scores 

.2o 

• 36 

.27 

Modified  Test  Scores 

.^3 

.43 

.2» 

•jd 

Further  study  would  be  necessary  to  determine  whether  these  substantial 
correlations  were  due  to  common  subject  master  underlying  the  various 
formats  or  to  other  common  variables  not  necessariljr  part  of  electronics 
troiible  shooting  skills.  It  is  probable  ti.at  thesaj  results  with  paper- 
and-pencil  tests  v;ould  ne  t api-’ly  to  electronics  achievement  test?  in. 
generai.  The  many  possibilities  for  different  paper-and-pencil  formats 
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for  representing  electronics  trouble  shooting  problems  have  not  yet  been 
widely  explored  or  objectively  evaluated. 

2.  Ability  Reference  Tests . The  correlations  of  scores  on 
the  „ab-sample  and  MASTS  tests  v/ith  the  various  ability  reference  tests 
are  given  in  Table  VI.  All  were  statistically  insignificant.  The  small 
sample  affords  little  basis  for  interpreting  the  obtained  differences 
among  coefficients.  However,  it  is  probable  that  the  Job-sample  and 
Masts  tests  are  factorially  quite  complex.  They  may  sample  many  sources 
of  variation  besides  those  accounted  for  by  the  reference  tests. 

Table  VI 

Rank  Order  Correlations  Between  Performance  Tests  (Job  Sample  and  MASTS) 
and  Seven  Printed  Reference  Tests 

M = 36 


Jcb  Sample 
Total 

MoSTS 

Total 

Modified 
MAST  S 

Spatial  Visualization 

.29 

.09 

.01 

Problem  Solving 

.24 

.14 

-.07 

ver&ai  OoiDpx'eneaai oa 

w io 

.ay 

- , XU 

Circle  Reasoning 

.10 

.07 

-.15 

Wo ♦ ^0  c M 

.PR 

- .04 

Brick  Uses;  Ideational 
Flxiency 

-.02 

-.04 

.22 

Brick  Uses:  Spontaneous 
Flexi bill ty 

-.10 

.14 

-.21 

Logical  Reasoning 

.16 

.24 

.12 

3.  Supervisor ' 3 Perforuance  Ratings . The  various  measures 
of  electronics  performance  were  related  to  estimates  of  general  trouble 
shooting  ability  of  the  subjects,  by  a rating  obtained  from  tiie  job 
supervisor  (usually  the  electionics  material  officer)  of  each  man. 


A fifteen  point  genie  was  uaed  with  verbal  anchors  at  the  extremes  end 
the  center.  The  form  used  is  in  Table  B in  the  appendix.  It  was  pos- 
sible to  obtain  ratings  on  thirty  of  the  thirty-six  subjects. 

The  correlations  of  ratings  '.•.’1th  scores  on  the  experimental 
measures  are  given  in  Table  VII.  With  the  exception  of  the  MASTS  test 
scores,  the  results  were  quite  in  agreement  with  what  would  be  expected 
in  terms  of  the  intercorrelations  of  the  tests.  Because  the  MASTS  re- 
s\ilts  appeared  to  be  atypical,  a comparison  in  terms  of  significance  of 
the  relationship  between  the  ratiiigs  and  the  job-sample  and  the  MASTS 
testa  was  made.  This  was  done  by  converting  both  sets  of  data  into 
2x2  contingency  tables  and  computing  a chi  square  test  of  independence. 

Table  VII 

Hank  Order  Correlations  Between  Performance  Tests  and  Supervisors'  Rating 

N = 30 


Job  Sample 
Total 

MASTS 

Total 

Electronics  Modified 
Ref.  Tests  MASTS 

Ratings  >50 

.21 

.U6  .52 

On  the  basis  of  this  test  one  would  discard  the  hypothesis  of  "independ- 
ence" bet^.een  job-sample  scores  and  ratings  at  the  2^^  level  of  signifi- 
cance: whereas  the  sa.me  hypothesis  with  reference  to  .MASTS  scores  and 
ratirigs  would  be  discarded  at  ti;e  10‘p  level.  It  would  thus  appear  safe 
to  conclude  there  v.-as  a significant  relation  between  superiors'  ratirigs 
and  job-sample  performance  but  not  between  .ratiirgs  and  MA.ST3  scores. 

This  latter  res’ilt  is  at  variance  '//ith  the  higher  relationship  between 
the  ratings,  the  electronics  reference  tests,  ana  tne  modified  M-^iSTS  test 


C.  Analysis  of  Test  Admlnl stration  and  Problem  Variables 

It  ’.vill  be  recalled  from  tlie  earlier  discussion  of  the  experimental 
design  that  a conpromise  was  made  between  two  objectives:  (1)  to  systema- 
tically vary  order  end  problem  group  variables  to  determine  their  effect 
on  job-sample  and  MASTS  scores;  (2)  to  maintain  homogeneous  administra- 
tive conditions  as  a basis  for  estimating  true  correlations.  Tne  effects 
of  the  administration  variables  and  some  of  the  internal  characteristics 
of  the  tests  will  be  considered  in  this  section. 

1.  Test  Order . Because  the  tasks  presented  to  the  subjects 
by  the  job-sample  and  MASTS  tests  were  similar,  it  was  predicted  that 
the  order  in  which  the  tests  were  taken  v/ould  influence  the  scores  on 
each.  The  job-sample  t.est  used  equipment  whicli  probably  was  more  fami- 
liar to  me  men  ti;on  was  the  lUSTS  test  format.  Therefore,  it  was  pre- 
dicted that  the  ^lA3TS  test  would  profit  more  from  being  given  second 
than  v/ould  the  job-sample  test.  The  counterbalanced  design  provided 
for  oooh  ♦est  to  ><o  o-5ven  first  and  each  to  be  given  second  an  equal 
number  of  times,  to  control  this  order  vaidable-  It  is  apparent  from 
Table  VIII  that  the  order  in  which  the  tests  were  administei cd  did  have 
a slgnificent  influence  on  the  test  scores.  The  job-sample  test  had  a 
significantly  greater  number  of  solutions  and  h shorter  median  solution 
time  v/hen  given  first  than  when  given  second.  The  MASTS  test  yielded 

a greater  (not  significant)  number  of  solutions  and  a significantly 
shorter  median  solution  time  when  given  second  than  when  given  first. 

2.  Problem  Group  Differences  = Thro’jgh  the  use  of  the  counter- 
balanced design  it  was  possible  to  administer  two  complete  sets  of  prob- 
lems in  all  orders.  The  sets  of  receiver  items  were  labeled  I arid  II 

-1?- 
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Table  VIII 


Differences  in  Mean  Uunbers  of  Solaticns  ana  Means  of  Individual  Median 
Solution  Times  for  Two  Orders  of  Test  Administi’ation 

S = 24 


Administration  Order 

O' 

First 

Second 

Diff . 

riff. 

t 

liumber  correct  solutions 

Job  Sample 

8,8^ 

7. 08 

1-73 

.79 

2.21* 

MASTS 

6.17 

7*33 

1. 16 

• 15 

1.56 

Means  of 

Median  Solution  Times 

Job  Sample 

15.62 

23.54 

7.92 

5 . 80 

2.08* 

MASTS 

17.62 

11.65 

5.58 

1.88 

3.17*‘ 

* Significant  at  .0|3  level 
••Significant  at  .01  level 


and  the  red( r items  4 and  fl.  A comparison  of  the  mean  number  of  solu- 
tions for  these  two  sets  of  problems  xs  given  in  Table  IX,  and  a similar 
comparison  of  solution  times  in  Table  X.  It  is  evident  from  both  seta 

Table  IX 


Oomoi* r i 9 of  Correct  Ccluticr*s 
for  Lifferent  hrooleu  Groups 
(iJ  for  each  sub-group  is  12) 


Tea  t 

Problem  Group 

Diif . 

O'  Biff, 

t* 

Masts 

Radar 

A B 

2.50  3.3« 

1.08 

. kol 

2.34 

Job  Sample 

0 

0 

4.00 

1.00 

0 

OQ 

1-97 

MASTS 

^ Receiver 
. 4.08  3.33 

.75 

,475 

1,58 

Job  Sample 

4,75 

4.17 

.58 

,7458 

1.27 

t = 2.07 

t = 2.82 


1C 


•Signif icance  levels: 
(22  d.f.) 


of  data  that  problem  groiips  A oM  B (radar  problems)  differed,  whereas 
groups  I and  II  (receiver  problems)  did  net.  In  the  future,  use  of 
these  problems  would  profit  from  a study  cf  the  radai’  problem  groups  to 
account  for  the  differences,  and  to  remove  factors  producing  inequality 
if  it  were  desired  to  use  the  groups  as  alternate  or  equivalent  tests. 

Table  X 

Differences  in  Solution  Times  for  Different  Problem  Groups 
Based  on  Means  of  Individual  Median  Solution  Times 
(N  for  each  sub-group  is  12) 


Test 

Problem  Group 

Diff . 

Diff. 

t 

Radar 

A 

■ _3_ 

MASTS 

18.23 

12.53 

5.67 

1.40 

4.05** 

Job  Sample 

29. 

19.25 

10.53 

3.18 

3.25** 

Receiver 

I 

11 

MASTS 

10 . 62 

13.21 

2,59 

2.07 

1.25 

Job  Sample 

15.25 

16.38 

1.63 

3.53 

.46 

""^Signif leant  at  .01  level 

j.  Dffcct  of  Order  Wi thin  Problem  Groups . In  the  counter- 
balanced design,  the  order  in  which  individual  problems  within  a par- 
ticular problem  group  were  administered  to  tne  subjects  was  varied  sys- 
tematically from  subject  to  subject.  The  purpose  of  this  was  to  control 
the  effects  of  warm-up,  fatigue,  frustration,  etc.,  and  to  provide  some 
degree  of  test  security.  A graph  was  drawn  of  the  solution  times  over 
all  problems  to  show  the  influence  of  sequence  position.  See  Figure  1, 
and  comparable  data  for  number  of  solutions  in  Figure  2.  There  is  con- 
siderable evidence  for  sequence  effects  on  both  variables . Performance 
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generally  was  poor  on  the  first  protlams  tried;  improved,  and  sometimes 
returned  to  a lower  level  after  four  or  five  problems. 


Sequence  Position 


masts 

Test 


Median  solution  times  per  problem  for  the  Job  Sample  and  MASTS 
Tests  as  a function  of  the  sequence  position  of  the  individual 
problems.  N = 24 


V 


Number 
for  li 


Sequence  Position 

of  correct  solutions  of  Job  Sample  and  MASTS  problems 
fferenl  problem  sequence  positions.  N = 24 
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4.  Internal  Characteristics  of  the  Tests . The  preliminary 


administration  of  the  job-sample  and  MASTS  tests  yielded  information 
for  evaluating  tne  tests'  internal  characteristics  - particularly  for 
selecting  the  most  effective  problemrs,  eliminating  the  poor  ones,  and 
matching  problems  on  difficulty  level.  Because  the  preliminary  findings 
were  favorable  to  the  continued  use  of  such  tests,  an  extensive  revision 
of  the  MASTS  test  has  been  \indertaken.  Therefore,  the  bulk  of  the  data 
on  the  Internal  properties  of  those  tests  will  be  presented  in  a later 
report  describing  the  revised  measures. 

Cne  comparl son  which  is  of  interest  in  this  context  is  the 
correlation  between  sub-tests  or  part  scores  on  the  two  trouble  shooting 
tests.  The  results  are  shown  in  Table  XI. 

Table  XI 

Hank  Order  Correlations  Between  Receiver  and  Radar  Scores 
on  the  Job  Sample  and  MaSTS  Tests 
(For  tne  Homogeneous  Group,  N = 18) 


Variables 

Rho 

Job  Sample:  Receiver  vs.  Radar 

.53 

MASTS:  Receiver  vs.  Radar 

.30 

This  low  correlation  for  the  MASTS  test  (like  those  in  Table  IV)  can  be 
attributed  in  large  part  to  tne  fact  that  the  variability  in  each  half 
of  the  test  (6  problems)  was  very  low  (most  subjects  getting  from  3 to 
5 correct) . 

In  an  attempt  to  estimate  the  internal  consistency  reliability 
of  the  job-sample  and  MASTS  measures  a rank  order  correlation  coefficient 
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was  compnted  'between  the  number  of  correct  solutions  among  odd-even 
halves  of  the  individual  tests-.  These  results  are  shown  in  Table  XII. 

Table  XII 

Rank  Order  Correlations  Between  Scores  Derived  From  Cdd  and  Even 
Halves  of  the  Job  Sample  and  M/.SPS  Tests 
(Number  of  correct  solutions  v/ith  ties  resolved 
■bj-  solutions  times;  Homogeneous  Group,  N = 18) 


Test 

Rho* 

Job  Sample 

.47 

MASTS 

.50 

’•Coriected  ty  Spearman  Bj-owu  form.ilo 


It  should  be  noted  in  interpretiUfe  tiiese  correlations  that  the  division 
of  tnese  tests  into  odd  and  even  halves  drastically  curtails  the  poten- 
tial range  of  scores.  Each  ''half"  consists  of  only  three  problems. 

V.  SUMMARY  AND  CONCIUSIONP 

This  study  was  concerned  with  the  development  of  a symbolic  rep- 
resentation of  certain  aspects  of  the  electronics  trouble  shooting  task, 
the  MASTS  Test,  and  with  the  relation  of  the  scores  obtained  from  tiiis 
Instrument  to  other,  more  conventional  measures.  Among  these  were  a 
job-sample  equipment  test,  electronics  reference  tests,  ability  refer- 
ence tests,  and  supervisor  ratings. 

The  extremely  long  testing  time  required  per  subject  for  the  two 
trouble  shooting  tests  precluded  their  administration  to  the  number  of 
subjects  originally  planned,  which  would,  have  been  more  satisfactory 
for  correlational  analyses  as  well  as  for  other  comparative  analyses. 
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However,  the  results  of  the  study  were  encourn^in,-;  with  respect  to  the 
MASTS  test.  Significant  correlatione  were  obtained  between  the  MASTS 
test  and  its  Job-sample  counterpart. 

Besides  the  results  reported  here,  the  study  yielded  exploratory 
tryout  and  preliminary  test  construction  data  on  the  three  major  desses 
of  electronics  trouble  sliooting  measures  involved.  These  are  beir,g  used 
currently  in  the  revision  of  the  MASTS  test. 


--dSrr-,. 
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APPENDIX 


TABLE  A 

Tabulation  of  ET  Samples  by  Ships 


Shi^o 

No.  of  ETs  in 
Final  Sample 

DDl 

2 

DD2 

2- 

DD3 

k* 

DD4 

2* 

DD3 

5* 

DD6 

5* 

DD7 

3 

DDS 

k' 

CAl 

9 

CVi 

2 

•Starred  samples  indicate  that  all  the  ETs  aboard  that  ship 
served  as  subjects;  in  other  ships,  complete  sampling  could 
not  be  achieved  because  of  various  operational  "'I ‘ions 
such  as  sailing  dates,  leaves,  training  programs,  etc. 


Table  b 
Subject  Data 


! 

1 

Naval 

ST 

Elec  tronics 

Schools 

1 

Experience 

in  Months 

Naval 

i Hate 

K 

O-ii. 

25  & over 

mm 

Civilian 

! ET/SN 

i 

2 

|[Mb 

Bi 

■ 

BH 

Imi 

18 

6 

B 

■ 

ET/2  _ 

10 

0 

H 

6 

10 

B 

m 

1 

■ ■»  1 

0 

0 

1 

1 

A 

0 

”■'■1 

TOTAL 

■1 



R1 

2 

11 

•Experience  data  was  not  available  for  two  ET/3  subjects. 
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PLATE  2 PHC'TOoRA^HS  OF  THE  PHILCO  ELECTRONICS  TRAINING  SET. 
B.  SIMPLIHED  RADAR  SYSTEM, 


BASIC  RADAR  SWEEP  GENERATOR  CIRCUIT  DIAGRAM. 


